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Abstract  , ( 

The  main  tool  uaed  in  studying  the  Influence  of  given  perturbation  parame- 
ters on  a given  optimization  problem  is,  of  course,  the  corresponding  Rockafellar 
dual  problem  (in  which  the  dual  variables  are  in  a one-to-one  correspondence  with 
the  parameters).  However,  even  when  the  given  optimization  problem  is  defined  in 
terms  of  simple  formulas,  there  are  many  important  cases  where  the  corresponding 
dual  problem  can  not  be  computed  explicitly  (in  terms  of  simple  formulas)  unless 
certain  additional  (uninteresting)  perturbation  parameters  are  included.  Under 
a very  weak  hypothesis,  the  main  theorem  to  be  given  here  asserts  that  a (sub)- 
optimizatlon  of  the  resulting  dual  problem  over  the  additional  (uninteresting) 
dual  variables  produces  the  desired  dual  problem  (l.e.,  the  dual  problem  that 
corresponds  to  the  original  optimization  problem  without  the  additional  perturba- 
tion paraswters).  In  addition  to  its  uses  in  parametric  analysis  this  theorem  can 
be  used  to  show  that  various  decomposition  principles  are  dual  to  one  another  and 
hence  are  essentially  equivalent. 
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1.  Introduction.  A given  optimization  problem  la  seldom  studied  In  Isolation, 

but  is  usually  eafcedded  In  a parameterized  family  of  closely  related  optlmiza- 

, * 

tion  problems.  There  are  generally  many  such  families  to  choose  from,  but  for 
practical  reasons  the  family  chosen  asually  includes  as  parameters  at  least  all 
of  the  potentially  variable  "problem  Inputs".  The  other  parameters  Included 
may  not  have  any  practical  significance,  but  are  chosen  because  their  presence 
makes  certain  computations  much  more  tractable.  In  defining  the  parameter 
scales  It  is  advantageous  to  make  zero  coincide  with  the  given  problem,  so  that 
the  input  parameters  can  also  be  interpreted  as  perturbations  of  the  given  input 
data. 

In  engineering  design,  management  science,  and  operations  research  there  are 
at  least  two  conpelling  practical  reasons  for  studying  such  problem  families: 

(1)  a designer  or  decision-maker  frequently  needs  to  know  how  his  optimal  design 

or  decision  changes  with  changing  input  data;  and  (2)  he  also  needs  to  know  the 

* > 

sensitivity  of  his  optimal  design  or  decision  to  small  perturbations  of  his  given 
input  data,  so  that  he  can  establish  the  accuracy  needed  for  such  data.  Moreover, 
in  the  prediction  of  scientific  phenomena  through  the  use  of  variational  princi- 
ples there  are  clearly  analogous  reasons  for  studying  such  problem  families. 

Of  course,  the  Indispensable  tool  to  be  used  in  all  such  studies  is  the  corre- 
sponding Rockefeller  dual  problem  [l3,lb,15]. 

In  "ordinary  mathematical  programming"  the  only  perturbation  parameters  con- 
sidered are  those  that  perturb  the  given  upper  and/or  lower  bounds  placed  on  the 
constraint  functions.  As  demonstrated  on  page  320  of  [1U],  the  corresponding 
Rockefeller  duel  problem  is  then  Just  the  "ordinary  duel  problem"  thet  evolved 
from  the  ’Wolfe  dual  problem"  [16]  via  the  work  of  Falk  [UJ.  Unlike  duality  in 
linear  programming,  the  ordinary  dual  problem  generally  can  not  be  co^utad  ex- 
plicitly (in  terms  of  simple  formulas),  even  when  the  objective  and  constraint 
functions  la  the  given  problem  are  expressed  in  terms  of  slnple  forsulas . 
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1.  Introduction . A given  optimization  problem  la  seldom  studied  in  isolation, 


but  is  usually  enbedded  in  a parameterized  family  of  closely  related  optimiza- 

a 

tion  problems.  There  are  generally  many  such  families  to  choose  from,  but  for 
practical  reasons  the  family  chosen  asually  includes  as  parameters  at  least  all 
of  the  potentially  variable  "problem  inputs".  The  other  parameters  Included 
may  not  have  any  practical  significance,  but  are  chosen  because  their  presence 
makes  certain  cosgmtations  much  more  tractable.  In  defining  the  parameter 
scales  it  is  advantageous  to  make  zero  coincide  with  the  given  problem,  so  that 
the  input  parameters  can  also  be  interpreted  as  perturbations  of  the  given  input 
data. 

In  engineering  design,  management  science,  and  operations  research  there  are 
at  least  two  compelling  practical  reasons  for  studying  such  problem  families: 

(1)  a designer  or  decision-maker  frequently  needs  to  know  how  his  optimal  design 
or  decision  changes  with  changing  input  data;  and  (2)  he  also  needs  to  know  the 
sensitivity  of  his  optimal  design  or  decision  to  small  perturbations  of  his  given 
input  data,  so  that  he  can  establish  the  accuracy  needed  for  such  data.  Moreover, 
in  the  prediction  of  scientific  phenomena  through  the  use  of  variational  princi- 
ples there  are  clearly  analogous  reasons  for  studying  such  problem  families. 

Of  course,  the  indispensable  tool  to  be  used  in  all  such  studies  is  the  corre- 
sponding Rockefeller  dual  problem  [13,14,15] . 

In  "ordinary  mathematical  programming"  the  only  perturbation  parameters  con- 
sidered are  those  that  perturb  the  given  upper  and/or  lower  bounds  placed  on  the 
constraint  functions.  As  demonstrated  on  page  320  of  [14],  the  corresponding 
Rockefeller  dual  problem  is  then  just  the  "ordinary  dual  problem"  that  evolved 
from  the  'Wolfe  dual  problem"  [16]  via  the  work  of  Falk  [4].  Unlike  duality  in 
linear  programming,  tha  ordinary  dual  problem  generally  can  not  be  computed  ex- 
plicitly (In  tarms  of  simple  formulas),  even  when  the  objective  and  constraint 
functions  in  the  given  problem  are  expressed  in  terms 
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of  simple  forailas. 


According  to  Rockafellar  (on  page  322  of  [14]),  this  major  obstacle  to  working 

with  the  ordinary  dual  problem  Is,  In  a certain  sense,  due  to  the  fact  that  the 

0 i 

upper  and/or  lower  bound  perturbation  parameters  "are  not  enough  to  compensate 
for  nonlinearities  of  the  constraint  functions".’ 

In  (generalized)  "geometric  programming"  there  are  additional  perturbation 
parameters  that  compensate  for  such  nonllnearltlea . In  fact,  [12]  (and,  for  a 
limited  formulation,  page  324  of  [14])  shows  that  the  corresponding  Rockafellar 
dual  problem  is  then  just  the  "geometric  dual  problem"  that  evolved  from  Chap- 
ter VII  of  [3]  via  the  work  of  Peterson  [7,8,91*  Like  duality  in  linear  pro- 
gramming, the  geometric  dual  problem  generally  can  be  computed  explicitly  (in 
terms  of  functions  that  in  many  important  cases  have  very  single  formulas). 

In  fact,  geometric  programming  duality  is,  in  retrospect,  a more  natural  exten- 
sion  of  linear  programming  duality  than  is  ordinary  programming  duality. 

Some,  though  usually  not  all,  of  the  additional  perturbation  parameters  may 
actually  perturb  other  problem  input  data  and  hence  be  of  interest  in  their  own 
right.  In  fact,  this  phenomena  can  be  clearly  illustrated  by  the  following  five 
classes  of  optimization  problems  (which,  incidently,  also  indicate  how  geometric 
programadng  has  more  closely  unified  many  of  the  major  subfields  of  optimization 
theory). 

In  prototype  geometric  programming  (described  by  examples  1 and  6 in  sec- 
tions 2.1  and  2.2  of  [9]),  nonconvex  inseparable  ordinary  "posynomial"  optimiza- 
tion problems  are  formulated  as  convex  separable  geometric  programming  problems 
in  which  the  additional  perturbation  parameters  perturb  (the  logarithm  of)  the 
given  posynomial  coefficients.  Generally  many,  though  usually  not  all,  of  the 
posynomial  coefficients  are  potentially  variable  Inputs,  such  as  costs  per  unit 
quantity  of  naterldl. 

In  the  theory  of  "nonlinear  networks"  (described  by  example  5 In  section  2.1 
I9l)>  ^e  variational  principles  employed  are  In  essence  already  formulated  as 
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. ..  s , 

separable  geometric  programming  problems  In  which  the  perturbation  parameters 
perturb  the  given  input  "flows"  or  input  "potential  differences"  and  certain 
other  (physically  imperturbable)  quantities.  In  a recent  economics  extension  [10] 
the  perturbation  parameters  perturb  .the  given  input  "flows"  or  input  "costs"  and 
"prices"  and  certain  other  (economically  imperturbable)  quantities. 

In  the  theory  of  "dynamic  programming"  with  linear  "transition  functions" 
(described  by  example  U in  section  2.1  of  [9)),  the  multistage  optimization  prob- 
lems considered  are  readily  recognized  as  partially  separable  geometric  program- 
ming problems  in  which  the  perturbation  parameters  translate  and  hence  perturb 
the  given  "policy"  and  "state"  sets  as  well  as  the  given  "initial  state"  and 
"final  target"  sets. 

In  facility  location  theory  (described  by  exasq>le  3 In  section  2.1  of  [9]), 
the  inseparable  ordinary  "generalized  Ueber  problems"  considered  are  easily  formu- 
lated as  (partially  separable)  geometric  programsiing  problems  in  which  the  addi- 
tional perturbation  parameters  translate  and  hence  perturb  the  given  locations 
of  the  previously  existing  facilities. 

In  the  theory  of  "i  programming"  (described  by  example  2 in  section  2.1 
of  [91 )»  ip  constrained  /p  regression  problems  and  inseparable  ordinary  quad- 
ratlcally  constrained  quadratic  programming  problems  are  formulated  as  separable 
g«MMtrlc  programming  problems  in  which  the  additional  perturbation  parameters 
perturb  the  given  vector  that  is  being  "optimally  approximated". 

In  sumsmry,  the  geometric  programming  approach  to  a given  optimization  prob- 
lem is  generally  much  more  powerful  than  the  ordinary  programming  approach.  In 
fact,  many  inseparable  ordinary  programming  problems  can  be  formulated  as  sepa- 
rable geometric  programing  problems;  and  the  corresponding  geometric  dual  prob- 
provides  the  means  for  analyzing  the  effect  of  a much  broader  class  of  input 
perturbations.  Moreover,  there  are  many  important  cases  where  the  corresponding 
geometric  dual  problem  can  be  derived  in  terms  of  very  simple  formulas  even 
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though  the  corresponding  ordinary  dual  problem  can  be  expressed  only  Implicitly 
In  terms  of  the  solution  of  another  parameterized  family  of  optimization  prob- 

r 

lems  --  a dichotomy  that  Is  explained  in  [11]. 

Although  such  tractabillty  provides  a relatively  easy  analysis  of  the  corre- 
sponding problem  family,  the  preceding  five  examples  indicate  that  In  many  impor- 
tant cases  such  problem  families  are  larger  than  desired;  that  Is,  they  have 
perturbation  parameters  that  perturb  given  input  data  that  is  actually  imper- 
turable  according  to  real-world  considerations.  Such  excess  perturbation  parame- 
ters can  be  a dimensional  curse  because  they  can  drastically  increase  the  nunfcer 
of  certain  computations  without  any  corresponding  increase  in  the  amount  of  usable 
information.  However,  the  main  theorem  to  be  established  here  implies  that  such 
perturbation  parameters  can  be  effectively  deleted  (i.e.  kept  equal  to  zero)  by 
suboptimizing  the  geometric  dual  problem  over  the  corresponding  dual  variables. 

In  large-scale  linear  programing  it  is  known  that  the  "Benders  deconposi- 
tion"  [1]  of  certain  structured  dual  problems  (by  suboptimization)  is  "dual"  to 
the  "Dantzlg-Holfe  decomposition"  [2]  of  the  corresponding  primal  problems  (by 
Lagranglan  optimization).  That  type  of  decomposition  duality  can  be  viewed  as  a 
corollary  to  the  main  theorem  of  this  paper.  In  fact,  the  main  theorem  of  this 
paper  can  also  be  used  in  large-scale  geometric  programming  to  dualize  certain 
decomposition  principles  described  in  subsections  3. 1.6  and  3.3.6  of  [9]. 

The  only  prerequisite  for  this  paper  is  some  of  the  convexity  theory  in 
[14]  — especially  the  theory  having  to  do  with  the  "relative  interior"  (ri  S) 
of  an  arbitrary  convex  set  S c ^ (N-dimensional  Euclidean  space). 

2'  *ockafallar  duality.  Suppose  that  g:C  is  a (proper)  function  g with  a non- 
a^pty  (effective)  domain  C c E^  , and  aasume  that  the  Independent  variable  (d,p) 
in  C is  tha  Cartesian  product  of  a "decision"  (vector)  variable  d and  a "perturba- 
tion" (vector)  parameter  p . 


Consider  the  parameterized  family  G that  consists  of  the  following  optimiza- 
tion problems  A(p)  . 

a 

i 

PROBLEM  A(p)  . Using  the  "feasible , solution"  set 

S(p)  = [d|(d,p)  6 C}  , 

calculate  both  the  "problem  infimum" 

<p(p)  = inf  g(d,p) 
d€S(p) 

and  the  "optimal  solution"  set 

s (p)  = [d  €S(p)|g(d,p)  = <p(p)}  . 

For  a given  perturbation  p , problem  A(p)  is  either  ’’consistent”  or  "incon- 
sistent”, depending  on  whether  the  feasible  solution  set  S(p)  is  nonenpty  or 
eapty.  The  (effective)  domain  of  the  Infimum  function  <p  is  the  "feasible  pertur- 
bation” set 

P = {p|problem  A(p)  is  consistent}  , 

which  is  obviously  identical  to  (p|(d,p)  €C  for  at  least  one  d}  and  hence  is  not 
empty.  Unlike  the  function  g,  the  function  <p  may  assume  the  value  -•  . However, 
for  our  purposes,  it  is  not  advantageous  to  follow  Rockefeller *s  custom  of  arti- 
ficially defining  g and  tp  to  be  +®  outside  their  respective  domains  C and  p . 

How,  suppose  that  g:C  has  a "conjugate  transform”  h:D  ; that  is,  suppose 
there  is  a function  h with  a nonempty  domain 

D = { (*»«)!  *«P  l<q,d>  + (e,p>  - g(d,p)]  < +■>} 

(d,p)  €C 

and  function  values 

h(q>«)  = *up  [<q,d>  + <e,p>  - g(d,p)]  . 

(d,p)€C 

The  inner  product  <q,d>  associates  the  "dual  perturbation"  parameter  q with  the 
"primal  decision"  variable  d,  and  the  inner  product  <e,p)  associates  the  "dual 
decision"  variable  e with  the  "primal  perturbation"  parasMter  p . 

Consider  the  parameterized  family  ft  that  consists  of  the  following  optimisa- 
tion problems  B(q)  . 
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PROBLEM  B(q). 


alculate  both  the  problem  lnflmum 


and  the  optimal  solution  set 


T (q)  = {e€T(q)|h(q,e)  = ^r(q)} 


Needless  to  say,  the  domain  of  the  infimum  function  \|r  Is  the  feasible  per 
turbation  set 


2 = [q|problem  B(q)  is  consistent}  , 
which  is  clearly  not  empty. 

Due  to  the  known  symmetry  [5,6,14]  of  the  conjugate  transformation  on  the 
class  of  all  closed  convex  functions  g:C  (as  well  as  the  obvious  symetry  of  the 
preceding  association  of  perturbation  parameters  and  decision  variables),  families 

G and  8 are  termed 


and  problems  A(o)  and  B(0)  are  termed 
Actually,  Rockafellar  [15,14,15]  formulates  8 as  a 
problems  by  placing  minus  signs  in  front  of  the  sup  and  e in 
Although  that  formulation  facilitates  specializations  to 
(the  standard  formulations  of)  linear  programming  duality  and  ordinary  programing 
duality,  the  preceding  formulation  facilitates  a specialization  [12]  to  geometric 
programing  duality. 

(*«)orient  the  reader  toward  the  preceding  formulation,  we  now  summarize 
Rockafellar's  moat  relevant  results  in  terms  of  that  formulation. 


family  of 


the  definition  of  h:D 


Theorem  0 


^ » 


I 


t 


(II)  the  lnflmum  function  cp  1b  finite  on  if  do— In  p if  end  only  If  the  duel 
problem  B(0)  is  consistent;  In  which  case 

(1)  the  duel  objective  function  h(0,'):T(0)  Is  the  conjugate  transform 
of  cp:P, 

, . I 

(11)  the  dual  lnflmum  f(0)  Is  finite  If  and  only  If  0 Is  In  the  domain  pc 
of  the  closure  cpC:pc  of  <p:P,  In  which  event 

0 = cpC(0)  + ^(0)  and  dq>C(0)  = T*(0), 

(111)  If  the  primal  problem  A(0)  Is  also  consistent,  then  0 Is  In  the 
domain  pc  and 

cpC(0)  s cp(0),  with  equality  only  If  dcpC(0)  = d<p(0), 

(lv)  the  lnflmum  function  cp  can  differ  from  Its  closure  <pc  only  at 
relative  boundary  points  of  P, 

(v)  If  the  dual  problem  B(0)  has  a (strongly)  feasible  solution  ef*  for 
which  (0,e*  )€(rl  D),  and  if  the  dual  lnflmum  t(0)  is  finite,  then 

(a)  primal  problem  A(0)  la  also  consistent. 

(b)  <p°(0)  = <p(0)  and  hence  0 = <p(0)  + t(0) 

(c)  the  primal  optimal  solution  aet  S*(0)  / 0. 

Conclusion  (v)  is,  of  course,  the  relevant  version  of  "Fenchel's  theorem". 

It  la  important  to  note  that  conclusions  (II)  and  (1)  to  Theorem  0 provide 

a method  for  constructing,  without  the  use  of  numerical  optimization  techniques, 
c c 

the  closure  q>  :P  of  cp:P  (which,  by  virtue  of  conclusion  (lv)  to  Theorem  0,  is 
essentially  the  desired  lnflmum  function  cp:P)«  In  particular,  if  the  dual 
faaalble  solution  set  T(o)  Is  not  empty  (which,  as  Indicated  by  conclusions  (I) 
snd  (II)  to  Theorem  0,  is  the  only  nontrivial  convex  case),  T(0)  can  of  course 

be  covered  with  e mesh 

**“{•>•  »•••»*  »•••)  c ^(o)  > 

which  need  only  contain  a finite  number  m of  points  e1  when  T(0)  is  bounded. 

Bach  mesh  M leads  to  both  an  approximating  function  that  bounds  qpc  from  below 
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and  an  approximating  function  that  bounds  op  from  above.  Moreover,  it  is  a con* 
sequence  of  conjugate  transform  theory  that  these  lower  and  upper  approximations 
can  be  made  with  arbitrary  accuracy,  simply  by  choosing  the  mesh  M to  be  suffi- 
ciently dense  in  T(0). 

To  obtain  the  lower  approximating  function,  first  note  that  conclusions 
(I)  and  (i)  to  Theorem  0 imply  that  <pC:pc  is  the  conjugate  transform  of  h(0,*):T(0). 
It  is  then  clear  that  <pc  is  bounded  from  below  on  pc  by  the  function  cp^  whose 
function  values 

<J>^(p)  = »up  K«Sp>  -*»(0,e1)]  for  each  p€pc. 

i€{l,2,...} 

Being  the  supremum  of  affine  functions  smkes  cp^  convex  and,  when  M is  finite, 
polyhedral . 

To  obtain  the  upper  approximating  function,  first  note  that  the  (Young- 
Fenchel ) "conjugate  inequality"  for  <pC:pC  and  h(0,*):T(0)  asserts  that 

<PC(p)  = (e1,?)  - h(0,ei)  for  each  p €beh(0,ei),  1=1,2,... 

It  is  then  clear  from  the  convexity  of  <pc  that  affine  interpolations  between  such 
function  values  bound  <pc  from  above.  In  fact,  cpc  is  obviously  bounded  from  above 
by  the  function  whose  function  values  are  simply  the  infimum  of  all  corre- 
sponding interpolated  values.  Clearly,  <p®  is  convex  and,  when  the  number  of 
interpolation  values  is  finite,  polyhedral. 

For  the  preceding  method  to  be  practical,  it  is  clear  that  the  dual  objec- 
tive function  h(0,*):T(0)  must  be  computed  explicitly  (in  terms  of  simple 
formulas)  --  a computation  that  may  be  possible  only  if  certain  additional 
(uninteresting)  perturbation  parameters  are  Included  as  components  of  p . How- 
ever, the  following  section  shows  how  to  subsequently  delete  such  additional 
parameters  (i.e.  keep  them  sero)  by  judiciously  choosing  each  mesh  M. 
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■wiMir* 


mite.  Th«  duality  between  auboptlmlaation  end  parameter  deletion 


cen  be  cryatalllced  ee  the  following  theorem. 


rem  1. 


tioo* 


g:C  ie  convex  end  closed,  end  let  the  coi»onent  parti- 


(d,p)  = (d,p*,p#  ) 


(q,«)  = (q,®',«# ) 

be  compatible  in  the  eenae  that  p'  and  e'  have  the  game  dimension  (which 
of  couree  that  f end  f eleo  have  the  seme  dlmenelon).  If  0 € (ri  f?)  where 

I*  * {pf  |(<*,P',lO  €C  for  at  least  one  (d,p')}, 
then  a deletion  of  p*  la  the  dual  of  a (aub optimisation  over  £ in  the  eenae  that 
(1)  the  function  gf  :<?  with  domain 


<?  - { (d,p*)| (d,p»,o) €C] 


8*  (*>P’)  = g(<*,P’,0) 


h°  :1f  with  domain 


If  * f (e.a')l  (q.e* ./  ) €D  for  at  leaat  one  i \ 


«h«r® 


(11)  the  get 


tf(q,e')=  inf  h(q,e’/  ) 
€T#(q,e' ) 


»,(*'•’>  - {/|<q,«*,/  )€D) 


T*(q,«’)  - {*  €T#(q,e')  |h(q,e',rf  ) - h*  (q,e'» 
isk  (q,«')€B*. 


9 


Proof.  For  • fix ad  but  arbitrary  (q,e')  consider  tha  prograaalng  faally  whose 
lnfimum  function  qf(  .;q,a'):(*  has  function  values 

= inf  lg(d,p',0)  -<q,d>-  <e',p*>]  , 

(d,p’)  €S\p*) 

where 

«TlO  = {(d,P,)|(d,P,,Pa>  €C}  . 


The  function  g(*,x*#  ) " (q>*)  " (o^x^C  clearly  Inherits  convexity  and  closedness 
fron  g:C,  so  Theorem  0 can  be  applied  to  this  family  and  Its  dual.  To  conpute 
Its  dual,  slsply  observe  that 

sup  {<r,d>  + <r*,p')+<d*,lf)-ls(d,p',p,)-<q,d>-<e’,p'>]} 

(d,P,pT  €C 


is  finite  if  and  only  if  (r,r',d}  €0-  (q,e',0),  in  which  case  this  supremos 
equals  h(r  + q,r' + e»,rf) . Consequently,  the  dual  family  haa  an  lnfimum  function 

with  domain 

Sftq#*')  - {(*,r’)|(r,r',rf)  €D-  (q,e',0)  for  at  least  one  /} 
and  function  values 

* ■ I , -f  n nmn  t<v 

= inf  h(r+q,r'+e',rf), 

*€tf(r,r';q,a') 


where 


^r’jq,#')  - [*  | (r,r*,^  €D-  (q,e',0))  . 

t flbiv  b'&xtivo'j  ft  rj  ?!  ,vi^l  iliv>  *•  t. . r v. 

Mow,  the  hypothesis  that  0€(ri  ff)  along  with  conclusions  (I)  through  (i) 

of  Theorem  0 imply  that  <flO;q,e‘)  is  finite  if  and  only  if  f(0,0;q,e*)  / 0. 

But  this  means  that  sup  f <q,d>  ♦ (o^p1)  - tfd,p')}  is  finite  if  and  only  1/ 

/ v - (*#P’)€<? 

(q#«')€lr  ; in  which  case  (tha  dual  of)  conclusion  (v)  to  Theorem  0 (relative  to 
the  lnfimum  function  <0  :(*)  assorts  that 


• HTq,*') 


(d,p’)€<f 


n u- 


; m.!  i >eg  :o  -ne  vl 

T,U#«)  4 i * 

' 


ecortv 


t JMCiXO 


* * 


provided  we  cen  show  thet  there  exists  (d,p') €*(0)  for  which  (d,p',0)  € (rl  C). 
Towerd  thet  end,  observe  thet  where  J Is  the  orthogonel  projector 

r 

onto  the  praxes.  Prow  the  hypothesis  thet  C Is  convex  end  from  Theorem  6.6  on 
page  U8  of  [1U]  we  now  Infer  that  (rl  |*)  = J(rl  C).  Consequently,  the  hypothesis 
that  0 € (rl  |*)  lsqplles  the  existence  of  a point  (d,p',0)€(rl  C)  for  which 
(d,p')  6^(0)  . q.e.d. 

It  Is  Important  to  note  that  conclusion  (1)  to  Theorem  1 Is  the  key  to 

extending  our  parametric  programing  method  to  a method  for  constructing,  with 

only  a limited  use  of  numerical  optimisation  techniques,  the  restriction  <pc ( * ,0) 
c c 

of  cp  :p  to  the  desired  domain 

Pc’  - {p’I(pSO)  *PC)  • 

In  particular,  observe  that  the  appropriate  dual  feasible  solution  set 

UO)  = {e'|(0,e')  €lf}  = {e'|(e*,«0  €T(0)  for  et  leest  one  . 

The  latter  representation  shows  that  1,(0)  Is  not  empty  If  and  only  If  T(0) 

Is  not  empty;  In  which  case  i;(0)  can  be  computed  explicitly  In  terms  of  T(0), 
even  though  It  Is  generally  Impossible  to  compute  tf(0,e’ ) explicitly  In  terms 
of  h(0,e',^).  Consequently,  given  that  T(0)  Is  not  empty  and  can  be  computed 
explicitly  (In  terms  of  simple  formulas),  the  latter  representation  shows  that 
%(0)  can  also  be  computed  explicitly,  and  hence  cen  easily  be  covered  with  a 
mesh 

^ * {•'  >•'  »•••>*'  »•••)  C T*(0)  • 

lech  mesh  X*  leads  to  both  an  approximating  function  that  bounds  q>c(*,o)  from 
below  end  an  approximating  function  that  bounds  q>c(  >,0)  from  above  --  approxl- 
mntloms  that  cen  be  made  with  arbitrary  accuracy,  simply  by  choosing  the  mesh 
If  to  be  sufficiently  dense  In  %(0)  . 

■on,  the  derivation  at  the  end  of  section  2 (applied  to  f : Cf  and  h*:  If  , 
rather  than  to  g:C  and  h:D)  produces  the  lower  approximating  function  <p®  whose 
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function  value* 


(p'jO)  = »up  l(e'i/P')  - WTO,*'*)]  for  each  p'Cp0*  . 

i €{1,2,...}  • 

Note  that  the  only  nontrivial  ingredient*  in  this  foraula  are  the  misters 

€{1,2, . --  ousters  that  can  b*  obtained  from  (sub)optlMtions  of 
h(0,e,l,€f)  over  €1^(0, e'1)  , hopefully  "with  only  a Halted  use  of  numerical 
optimization  technique*"  (because  of  a hopefully  saall  dimension  for  t). 

The  derivation  at  the  end  of  section  2 also  produces  the  upper  approxl- 
mating  function  <p“  whose  function  values  arc  slaply  the  lnflM  of  all  corre- 
sponding Interpolated  values,  cosputed  from  the  Interpolating  values 

<PC(P',0)  = (e'SpO-tfltOje’1)  for  each  p^d^tfTo,*'1)  , 1-1,2,... 

However,  the  sets  d^.tf^e*1),  i € { 1 ,2 , — } In  this  foraula  ar*  generally 
difficult  (if  not  ltqiosslble)  to  compute,  due  to  a lack  of  sl^le  formulas 
for  h#(0,*):X,  (0). 

The  following  theorea  provides  a remedy  for  the  preceding  difficulty. 

Theorem  2 . If  the  hypotheses  of  Theorea  1 are  satisfied  and  if  e'  € t (0)  , 
then 

(1)  there  exists  at  leaat  one  vector  n*  g^.hVo.cM  when  a*  gfrlX/oU. 

(11)  (p',0)  €d#h(0,e',rf#)  gen  p*  €^,^(0,0')  and  €T*tO.*M. 

(ill)  <pC(p',0)  - <*•,?’> -h(0,e',«T*)  ghs.  (p',0)€d#h(0,e',*#). 

Proof.  Conclusion  (1)  Is  an  lHMdiate  consequence  of  convexity  theory,  because 
h (0,*):Xi  (0)  is  the  conjugate  transfora  of  q>(*,0)  and  hence  is  convex  and  closed. 
To  prove  conclusion  (11),  observe  that 

*>*(0,e't)*mo, e*)+<p', a't-e»>  for  each  *»tC1*(0). 

But  h*(0,a* ) - h(0,*’,/*),  so 

h*(0,*,t)ah(o,e,,/*)'f  <p',e*t- *•>  far  each  e't€*(0). 
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Using  the  definition  of  tf(0,e't)  , we  now  infer  that 

h(0,e't/t)ih(0,e'y*)  + (p.',e't-e'>  for  each  (e*t,e°  t)  € T(0), 
which  implies  that 

h(0,e't,d*t)*h(0,e',«r*)+((p',0),(e't,*t)-  (e*,0>  for  each  («'t/t)6T(0). 
Hence  (p',0)  €d#h(0,e',rf*). 

Conclusion  (iii)  is  immediate  from  conclusions  (I)  through  (i)  of  Theorem  0 
and  conjugate  transform  theory.  q.e.d. 

It  is  important  to  note  that  conclusion  (i)  to  Theorem  2 asserts  that  the 
sets  S(,h  (0,e ' ),  i €{1>2,...},  in  the  formula  for  interpolating  values,  are  not 
empty  when  it  c (ri^(O))  --  a rather  unrestrictive  condition  on  it  . Moreover, 
conclusion  (it)  to  Theorem  2 end  conclusion  (ii)  to  Theorem  1 together  i^ly 
that  each  p*  €d#,tf (t^e*1)  can  be  obtained  from  any  set  d#h(0,e,i,^ *)  for  which 
«P*€T#(0,e’  ).  Finally,  conclusion  (iii)  to  Theorem  2 asserts  that  our  formula 
for  interpolating  values  can  actually  be  expressed  in  tens  of  the  sets 

i f 

^•*(0,0*  )t  1 € {1,2, . . .)  sets  that  tend  to  be  (relatively)  easy  to  cosqmte, 
due  to  the  frequent  availability  of  (relatively)  simple  formulas  for  h(0, •):*((>). 

Decomposition  duality.  This  topic  Involves  e mlnlmax  representation 
[1U,  part  III)  of  the  Rockefeller  duel  problem  B(0)  in  terms  of  e (generalised 
Lagranglan)  saddle  function  X • 

To  construct  X from  the  given  function  g:C,  let 

X « (d|(d,p)  € C for  et  least  one  p}  , 

and  suppose  that 

*(*)  ■ (p|(*,p)  € C)  for  d € # . 

Also,  suppose  that 

•(<)  - {«|  i«f  !i(d,p)  - <e,p»  is  finite)  for  d € A , 
p€P(d) 
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and  let 


e = n E(d)  . 

d €£ 

Then,  £ has  domain  txC  and  function  values 

X(d}a)  » inf  [g(d,p)  - <e,p>]  for  d€fiande€e. 
p€P(d) 

To  obtain  the  mlnimax  representation  of  problem  B(0),  note  that 

inf  X(d;e)  = inf  inf  [g(d,p)  - <o,d>  - <e,p>] 
d €4  p€P(d) 

= inf  [g<d,p)-<o,d>-<e,p>] 

(d,p)  €C 

= - sup  [<0,d>  + <e,p>  -g(d,p)]. 

(<*,p)  €C 

These  equations  clearly  Imply  the  objective  function  Identity 

inf  £(d;e)  + h(0,a)  « 0 for  e€T(0); 
d €6 

from  which  we  readily  infer  the  minimax  (actually  maxlmin)  representation 

sup  Inf  £(d;a)+  Inf  h(0,e)  = 0 . 
eftdfj  e€T(0) 

How,  under  the  hypotheses  of  Theorem  1,  a saddle  function  £ :ff  y ff  can  be 
constructed  from  the  given  function  £ :<?  in  the  same  way  that  has  been 

constructed  from  g:C.  Moreover,  conclusion  (1)  to  Theorem  1 then  lsqtlles  the 
ainiaax  representation 

■**  inf  h(0,e',e#)  = 0 . 

• d€tf  •'  €1*(0)  t €T#(0,e') 

This  equation  expresses  the  duality  between  q generalised  Daatslg-Wolfe  decompo- 
sition and  a generalised  Bandars  decomposition.  The  outer  supremum  and  the  outer 
inflnun  are  the  respective  master  problems;  and  the  Inner  lnflma  decooyose  Into 
respective  lnflma  sums  when  there  is  sufficient  -separability  end  "sparsity  - 
requirements  on  g:C  that  can  best  be  understood  in  the  context  of  subsections 
3.1.6  and  3.3.6  of  [9],  viewed  from  the  vantage  point  of  [12]. 
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